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^j- ; Abstract 

Neuron is a noisy information processing unit and conventional view is that information in 

o 



the cortex is carried on the rate of neurons spike emission. More recent studies on the activity 
propagation through the homogeneous network have demonstrated that signals can be transmitted 
with millisecond fidelity; this model is called the Synfire chain and suggests the possibility of the 



spatio-temporal coding. However, the more biologically realistic, structured feedforward network 
. ,— i \ generates spatially distributed inputs. It results in the difference of spike timing. This poses a 

X 

question on how the spatial structure of a network effect the stability of spatio-temporal spike 
patterns, and the speed of a spike packet propagation. By formulating the Fokker-Planck equation 
for the feedforwardly coupled network with Mexican-Hat type connectivity, we show the stability of 
localized spike packet and existence of Multi-stable phase where both uniform and localized spike 
packets are stable depending on the initial input structure. The Multi-stable phase enables us to 
show that a spike pattern, or the information of its own, determines the propagation speed. 

PACS numbers: 87.19.La, 05.10.Gg, 05.40.-a 
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Neuronal synchrony observed in the cortex is thought to play functional roles like binding 
features during cognitive processes [l]. The mechanism of synchrony has theoretically been 
studied in several neural network models, e.g., pulse coupled oscillators 2, N, m, chaotic 
oscilfators B, and feedforwards corded networks aBSBQ. In genera!, experimental 
verification is required for the development of science, but many theoretical works on the 
level of neuronal circuits have been difficult to verify in experiments. Recently, a theory on 
synchronous activity propagation in a feedforward network has been demonstrated in vitro- 
silico ^j], and has established one of the rare connections between theory and experiments 
in the field of neuroscience. 

If identical neurons receive the same and temporally modulated input, the spike timing 
would be roughly synchronous even if the initial membrane potentials were distributed by 
noise Q]. The question in a feedforward network is, whether the timing of spikes within a 
layer becomes more synchronized or not as activity propagates through a sequence of neural 
layers. When feedforward connection is uniform with excitatory efficacy as a whole, the 
synchronous spike packet propagation is stable This model is called the 

synfire chain jf|, and experimental evidence for this model has been reported in vivo jl^j ]. 
and both in vivo and vitro jl^j ]. 

The connection in the cortex is, however, not uniform but inhomogeneous, and com- 
posed of excitatory and inhibitory synapses. It would be more reasonable for a feedforward 
network to have such inhomogeneous connectivity. For example, Mexican-Hat type connec- 
tivity, which excites nearby neurons and inhibits distal surrounding neurons, is a prevalent 
structure in the cortex. As an inhomogeneous structure generates inhomogeneous input to 
the next neural layer, it is not clear what types of spatio-temporal spike patterns are stable, 
and whether the spike packets are synchronized or not. In this letter, we study the dynam- 
ics of a feedforward network with Mexican-Hat type connectivity to explore the effect of 
more biologically plausible connection on the propagation stability of spike packets, and the 
dependence of propagation speed on its own spatio-temporal activity pattern. 

Model.- Consider a structured feedforward network composed of identical Leaky 
Integrate-and-Fire (LIF) neurons. Each neuron is aligned in a circled neural layer, and 
they project axons to the next neural layer with the Mexican-Hat type connectivity (Fig. 
[Q. The input to one neuron includes output from pre-synaptic neural layer and random 
noisy synaptic current. The dynamics of the membrane potential v\ of a neuron at position 
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FIG. 1: Network architecture. Each layer consists of iV units of neuron, which is arranged in a circle. 
Each neuron projects their axons to the post-synaptic layer with Mexican-Hat type connectivity. 



9 on layer / can be approximated into a stochastic differential equation, 
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where C is the membrane capacitance, R is the membrane resistance, jl is the mean 
of noisy input, rj(t) is a Gaussian random variable satisfying (r](t)) = and (r](t)r)(t')) = 
5(t — t'). D' is the amplitude of Gaussian noise. An input current I°^ l (9,t) is obtained 
by the weighted sum of synaptic currents r a,l ~ 1 {9,t) generated by pre-synaptic neurons. 
The synaptic current is derived from the convolution of firing rate r l ~ 1 (9,t) with the post- 
synaptic current time course a(t). Here, a(t) = j3a 2 texp(—at) where (3 is chosen such that 
single EPSP generates 0.0014 mV depolarization from resting potential. The Mexican-Hat 
typ e connectivity consists of a uniform term Wq and a spatial modulation term W\ cos(#) 
lq . The membrane potential dynamics follows the spike-and-reset rule: When v l e reaches 
the threshold Vth, a spike is fired and v l g is reset to the resting potential V rest . Throughout 
this paper, the parameter values are fixed as follows: C = 100 pF, R = 100 MQ, V^h = 15 
mV, V rest = mV, D' = 100, fx = 0.075 pA, a = 2, and = 0.00017. 

Theory.- The prerequisites for the full description of the activity of the network are time 
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FIG. 2: (a): Time courses of (ro(t),r c (t),r s (t)), and the Gaussian approximation of ro(t) are shown. 
The Gaussian distribution has mean value of i and the standard deviation of a. The approximated 
Gaussian curve is obtained by minimizing the mean squared error with ro(i) and the Gaussian 
curve, (b): The time courses of (tq (t), r°(i), r£(t)) are exhibited which correspond to the order 
parameter in the dimension of current. In both figures, results from numerical simulations with 
10 4 LIF neurons (squares) and the Fokker-Planck equation (solid lines) are shown. 

series of order parameters at arbitrary time t defined as follows: 

^(M, (5) 
r[it)= ^-r%t)cos(e), (6) 

J -TV ^ 

-r l (8,t)sin(6), (7) 

where r l (t) is a population firing rate of the neuron population, and r l c (t) and r l s (t) are 
the coefficients of the Fourier transformation of the spatial firing pattern, which represent 
the spatial eccentricity of activity at time t. Input currents are described with the order 
parameters as follows: 

I«; l (6,t) = W r«> l - 1 (t) 

+ Wt (rf-\t) cos(6) + rf-\t) sin(0)) , (8) 

where r^ cs y(t) = J° oo dt / a(t / ) r l ^ Qcs y(t — t') are also order parameters with the dimension 
of current. Given the time sequence of order parameters in pre-synaptic layer, the order 
parameters in post-synaptic layer are obtained through the following calculations. The 
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FIG. 3: Activities of 8 layers of feedforward network with four characteristic parameter sets. 
Evolutions of firing rate changes are illustrated with colors (see right color-bar). Figures on the 
upper figures are the response to an identical localized pulse input, and the lower figures are those of 
an uniform pulse input. Figures on the same column have the same Mexican-Hat type connectivity. 
There are four phase where different combination of spike packets are stable. 

stochastic equation (Eq. is equivalent to the Fokker-Planck equation |l| ^| in the limit 
of neuron number iV — > oo. Therefore, the probability density of membrane potential, 
Pg(v,t), of neuron 9 on layer / at time t obeys 

where D = | ("^r) 2 , and r = RC. One neural layer is divided into 100 regions to calculate 
the Fokker-Planck eqs. The resetting mechanism of LIF neuron requires absorbing boundary 
condition at threshold potential, P]j\ v= v ih = 0,, and the current source at resetting potential 
gives, 



r l (9,t) = d v P l e \ v=v+ -d v P l e \ v=v , (10) 

v rest * rest 

The time series of pre-synaptic layer order parameters, (r l Q~ l (t') , r 1 ' 1 (t') , r 1 ^ 1 (t 1 )) in the range 
of t f < t and the last condition (Eq. ITTj) gives the firing rate of each neuron. Applying the 
definitions of the order parameters in Eqs.©-© again, we can obtain the time series of order 
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FIG. 4: (a): Flow diagram with parameter (Wo,Wi) = (1,1.5) where both localized and uniform 
spike packets are stable. Two attractors in high r\ region (Localized) and high ro with t\ = 
region (Uniform) are shown. A sequence of arrows indicates the evolution of a spike packet in 
the (ro, <t/t, space, (b): Plot of propagation time At that is necessary time for a spike packet 
to propagate one neural layer. This results indicate that localized spike packets propagate slower 
than the uniform ones. 

parameters on the post-synaptic neural layer (r l (t) , r l c (t) , r l s (t)) . This sequential pro cess of 
calculating the order parameters is essentially equivalent to the former analysis which 
is restricted to a binary neuron model with no memory (McCulloch-Pitts neuron model). 
The difference of the analysis between LIF neuron model and the McCulloch-Pitts neuron 
model is that the former one requires order parameters function depending on time, and the 
latter uses only the order parameters on time step before. 

Results.- We show an example of the time courses of r (t), r l c (t), r s (t) in response to a syn- 
chronized input in Fig. [21 for both the numerical simulation of LIF neurons and the Fokker- 
Planck equation. The time course of order parameters calculated from the Fokker-Planck 
formulation (solid lines) well matches those of LIF neurons (squares). Our observation of 
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activities propagating through the network with various parameter sets indicate that there 
are two types of spike packets that stably travels along the network. In Fig. El we can see the 
responses of this network with four characteristic (Wo, W\) parameter sets. Each figures in 
the same row shares the same input time sequence. Here, input to initial layer is formulated 
in terms of the firing rate on the pre-synaptic layer, r l (9,t) = r ° "^L^i^ exp ( — ) . Here 
we use r = 500, T\ = 350 for the upper figures as a localized input and r = 900, r± = for 
the lower ones as a uniform input. The common parameters are a = 1 and i — 2. When 
both Wo and W\ are small, no spike packet can propagate (Non-firing). When the uniform 
activation term Wo is sufficiently strong, a uniform spike packet is stable (Uniform phase). 
Note that even if a localized input elicits a localized spike packet with several layers, it fi- 
nally decays to the uniform spike packet (Fig. El upper figure of Uniform phase). When the 
Mexican-Hat term W\ is strong enough, only a localized spike packet is stable (Localized 
phase). This local synchronous activity propagation is characteristic of this network and 
we call this a localized synfire chain. When Wq and W\ are balanced with a certain ratio, 
there exists a novel firing mode where both uniform and localized spike packets are stable 
depending on the initial input (Multi-stable Phase). 

For the quantitative evaluation of the shape of a spike packet, we define indices r ,r 1; 
and a to characterize the spatio-temporal pattern of a spike packet. (r ,ri) can be directly 
defined as follows: 



r = J dt r (t) - u spont , (12) 

n = fdt n(t), n(t) = VW*)) 2 + W*)) 2 - (13) 



These values are a natural extension of indices used in a study on the synfire chain j^. 
The basic idea of characterizing the spike packet was to approximate the firing rate curve 
with a Gaussian function as shown in Fig. |2J (yellow region), and the area and the variance 
of the Gaussian curve were used as indices of spike packets. Instead of these, we directly 
use the area of firing rate ro(t) minus the spontaneous firing rate z/ spont because the area 
of Gaussian is just an approximation of the area of r (t). Further, since we have another 
order parameter ri(t), we can naturally derive a new index r± as the area of order parameter 
ri(t). This index indicates the eccentricity of firing patterns. The index a, representing the 
measure of synchrony, is obtained as the variance of the Gaussian curve(Fig. |2J. To analyze 
the propagation speed of spike packets, the index of mean spike timing i is taken from the 



peak time of the Gaussian curve. 

In the Uniform phase, input with an intensity more than certain threshold generates a 
uniform spike packet. In this phase, this system can classify the input intensity into two 
states because there are two stable attractor; a uniform spike packet and a silent state. 
In the Localized phase, it has two attractors, a localized spike packet and a silent state, 
and information of the input position can be encoded. This network, however, cannot 
discriminate between no-input and strong but spatially uniform input. Because a uniform 
activity is unstable in this phase, and it leads to a non-firing state. In contrast, the Multi- 
stable phase has three attractors. The flow diagram illustrated in Fig. Ufa) shows the 
evolution of spike packets in the (r , cr/r, ri) space. It shows the existence of three attractor, 
uniform and localized spike packet, and non-firing state (region where a is very large). 
The Multi-stable phase can encode the above difference, and may play a functional role in 
enhancing the ability to discriminate the input difference. 

The propagation time for a spike packet obviously depends on the connection Wq and 
W\. Furthermore, spike packets in the Multi-stable phase in Fig. El indicate that the speed 
also depends on the propagating spike pattern. To investigate this effect, we calculate 
the difference of propagation times At = i post — i pTC with various W\ parameters after 
spike packets reach their stable states (Fig. Efb)). Within the plotted region, higher W\ 
reduces the propagation time of a localized spike packet. In contrast, the propagation 
time of the uniform spike packet does not depend on W\ because uniform activity leads to 
r c (t) = r s (t) = 0, so W\ term can be neglected. These results suggest that the speed of 
information processing in the brain depends on spiking patterns, or the representation of 
information. 

The model of a localized synfire chain provides a common test bed for several fields of 
neuroscience. It is not only theoretically tractable but also one of a few models that is experi- 
m entaU™ifiable Q ^ ,ocah Z ed synhre chain also has strong connection to pop ul at 10 n 



coding [la, [LjJ [2Q], because many of their neural substrate is also the Mexican-Hat type 
connectivity. Therefore, we believe that our results can bridge theoretical, computational, 
and experimental neuroscience and provide a deeper understanding of brain functions. 
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